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APPROXIMATE  MODELS  FOR  CENTRAL  SERVER  SYSTEMS 
WITH  TWO  JOB  TYPES 

by 
J.  P.  Lehoczky* 
D.  P.  Gaver** 

1.     INTRODUCTION 
1 . 1    General  Summary 

The  purpose  of  this  paper  is  to  provide  a  new  approximation 
technique  for  describing  the  performance  of  a  closed  queueing 
network  when  there  are  two  or  more  job  types  present,  and  the 
order  of  service  (scheduling  policy)  of  interest  does  not 
make  system  states  Markovian  in  the  number  present  at  each 
server;  "first-come,  first-served"  order  is  an  example.   The 
model  also  allows  incorporation  of  non-exponential  distributions 
to  represent  service  time  distributions.   Our  technique  drastically 
reduces  the  size  of  the  state  space  used  to  describe  complex 
processes.   Consequently,  it  facilitates  calculation  of 
state  probabilities  and  system  performance  measures  through  use 
of  numerical  methods  such  as  Gauss-Seidel  iteration.   It  is  also 
helpful  in  simulation  studies. 
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of  Scientific  Research  at  Carnegie-Mellon  University,  Grant 
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While  we  emphasize  applications  to  models  of  multipro- 
gramming systems  in  this  paper,  the  method  described  here 
may  be  employed  for  treating  other  job-shop-like  problems. 


1.2   Background 

Multiprogramming  computer  systems  have  often  been  repre- 
sented by  some  variant  of  the  classical  Markovian  cyclic  queue- 
ing,  or  repairman,  model  described  by  Feller  (1957).   Early  work 
by  Gaver  (1967)  and  Rice  (1971)  has  been  extended  and  improved 
upon  by  many  others,  e.g.  Baskett  et_  a_l.  (1975),  Buzen  (1973), 
Chandy  (1975),  Reiser  and  Kobayashi  (1974)  to  name  a  few. 
Validation  of  these  models,  and  applications  to  planning 
computer  systems,  have  been  reported  by  Giammo  (1976), 
and  Rose  (1976).   The  models  have,  by  and  large,  depicted  jobs 
or  programs  as  passing  in  a  probabilistic  (Markovian)  manner 
from  server  to  server  in  a  closed  network  of  queues  forming 
before  the  various  servers.   The  latter  are  identified  as  one  or 
more  Central  Processing  Units  (CPU) ,  and  one  or  more  Peripheral 
Processors  (PP) ,  such  as  disk  or  tape  drives,  or  input-output 
devices. 

Papers  by  Jackson  (1963)  and  Gordon  and  Newell  (1967) 
early  pointed  out  the  simple  "product  form"  structure  of  the 
long-run  (or  steady-state,  or  stationary)  joint  distribution  of 
jobs  present  at  each  server  in  certain  closed  cyclic  networks. 


The  latter  solution  holds  if  a  fixed  number  of  jobs  remain  in 
the  system,  and  if  job  holding  or  processing  times  at  Server  i 
are  identically  and  independently  exponentially  distributed, 
and  transitions  of  jobs  from  server  to  server  are  Markov, 
each  transition  from  Server   i   to   Server  j   having  the 
same  probability   p. ..   For  other  conditions  see  Chandy  (1975). 
The  latter  assumptions  have  frequently  been  made  in  modeling 
computer  system  behavior.   Baskett,  ejt  aJ.  have  also  obtained 
product-form  solutions  for  situations  involving  different  job 
types,  so  that  the  service  time  of  Job  Type  k  at  Server  i  has 

rate  parameter   ^t_-i  an^  the  between-servers  transition  prob- 

(k) 
abilities  are  specified  as   p. .  .   However,  special  queue 

disciplines  must  be  assumed  in  order  to  achieve  the  results. 
The  first-come,  first-served  (FCFS)  discipline  is  not  among  these, 
except  when  identical  service  rates  prevail.   And  yet  FCFS  is 
more  representative  of   PP   behavior  than  is,  for  example,  a 
processor-sharing  discipline. 

Computer  system  modeling  based  on  direct  application  of 
the  simplest  Jackson-Gordon-Newell  results  is  subject  to  question 
on  several  grounds.   First,  service  or  holding  times  need  not 
be  exponentially  distributed  (nor  independent).   Second,  a 
mixture  of  job  types  may  be  expected  in  many  real  computing 
systems.   For  example,  some  jobs,  e.g.  those  termed  compute- 
bound,  may  require  relatively  extensive  CPU  activity,  and  spend 
relatively  little  time  at  the  PP ' s ;  others,  the  I/O  or  peripheral- 
bound,  have  characteristics  that  are  the  reverse.   Also,  in  real 


systems  different  jobs  will  make  heavy  demand  for  information  on 
their  own  particular  PP's,  systematically  ignoring  others.   This 
behavior  is,  in  principle,  not  well-represented  by  the  homogeneous 
character  of  the  usual  cyclic  queueing  assumptions.   Additionally, 
non-exponential,  e.g.  hypo  or  hyperexponential ,  service  times  are 
of  course  not  properly  represented  by  simple  exponentials.   One 
remedy  for  this  deficiency  is  to  utilize  phase-type  distributions, 
see  Cox  and  Miller  (1965)  and  also  Neuts  (1977)  .    One  example  of 
a  phase  type  distribution  is  the  gamma  or  Erlang,  thought  of  as 
representing  a  sum  of,  say,  k   independently  and  exponentially 
distributed  random  variables.   Specification  of  the  phase  of  service 
in  progress  is  all  that  is  necessary  to  render  the  service 
process  Markov;  when  the  k —  phase  terminates,  service  is  complete. 
More  generally,  phase  distributions  arise  as  the  hitting  or  first- 
passage  time  of  a  continuous-time  finite  Markov  chain  with  one 
absorbing  state;  a  service  terminates  when  the  absorbing  state 
is  hit.   The  class  of  phase  distributions  is  large,  containing 
distributions  exhibiting  features  such  as  bimodality  and  nearly 
spiked  (delta  function)  behavior.   While  Markov  queueing  network 
analysis  to  include  phase  type  service  is  in  principle  not 
difficult,  in  practice,  it  may  result  in  rather  serious  computa- 
tional problems,  for  the  state  space  necessary  to  describe  the 
system  easily  becomes  enormous.   This  is  especially  true  when 
it  becomes  necessary  to  include  information  concerning  the  order 
of  jobs,  classified  as  to  types,  in  the  state  description. 
While  such  an  "exact"  analysis  may  be  carried  out  for  small 


Markovian  networks,  it  is  advantageous  to  reduce  the  state 
space  size  in  order  to  facilitate  numerical  calculations.   For 
that  purpose  we  therefore  introduce  and  evaluate  a  weighted 
processor  sharing  FCFS  model. 


2 .   A  Numerical  Approach  Via  an  Approximating  Process 

An  appropriate  Markov  central  server  model  of  certain 
multiprogramming  computer  systems  with  realistic  service  protocols 
can  be  constructed  by  specifying  an  elaborate,  large,  state  space. 
An  example  of  such  an  approach  is  that  of  Gaver  and  Humfeld  (1976), 
and  Humfeld  (1977).   In  the  latter  investigations  a  computational 
method  is  devised  for  deriving  the  equations  of  probability  balance 
for  a  system  having  two  job  types  and  FCFS  discipline  at  one  CPU 
and  at  each  of   k   different  PPs.   There  are   J.   jobs  (programs) 
of  each  type;  i  =  1,2. 

Such  a  model  may,  unfortunately,  be  far  too  large  to  be 
solved  numerically  for  realistic  systems.   In  the  next  section  we 
introduce  a  stochastic  process,  Markov  in  the  number  of  jobs  of 
each  type  at  each  processor,  that  approximates  the  behavior  of 
the  more  complex  process  required  to  describe  the  effect  of  FCFS 
disciplines.   Apparently  a  product  form  analytical  solution  will 
not  be  available  for  our  new  approximating  process.   However,  by 
eliminating  reference  to  both  number  present  and  type  order,  the 
state  space  size  is  dramatically  reduced.   In  terms  of  the 
approximating  processes  one  may  also  more  easily  study  many  different 
queue  disciplines  as  they  effect  performance  in  a  multitype  multi- 
programming environment.   In  effect,  processor  sharing,  FCFS 
and  various  priority  disciplines  may  be  given  a  unified 
treatment. 


3.   Weighted  Processor  Sharing  FCFS  Approximation 

For  clarity  of  exposition,  we  assume  that  each  of  the 

service  centers  has  a  FCFS  queue  discipline  and  that  there  are 

two  types  of  customers.   The  system  contains  a  fixed  number, 

say   J.,  of  jobs  of  type  i,  i  =  1,2.   On  device  j,  customers  of 

type  i  have  an  exponential  service  time  with  parameter   y ■ ■ 

(j  =  1  and  2  refer  to  PP1  and  PP2,  while   j  =  0   refers  to  the 

CPU).   We  define   N.. (t)   to  be  the  number  of  customers  of  type  i 

at  service  center  j,  i  =  1,2;  j  =  0,1,2.   With  a  processor  sharing 

queue  discipline  at  device  j  ,  •  {  (N  . .  (t)  ,  N  .  9  (t)  )  ,  t  >_  0} 

forms  a  Markov  chain  where  the  probability  a  customer  of  type  i 

completes  service  in   [t,t  +  dt]   is  given  to  be 

y  .N.  . (t)  dt/(N., (t)  +  N.0  (t)  )  +  o(dt),  i  =  1,2.   Witn  a  FCFS 
131  jl        j2  '  ' 

queue  discipline,  these  probabilities  are  completely  dependent 
upon  the  ordering  in  the  queue.   They  are   y,dt   and   0   if  a 
type  1  job  is  in  service, or  0  and   y~dt   if  a  type  2  job  is  in 
service.   To  preserve  the  Markov  property  and  properly  model  the 
system  one  must  keep  track  of  the  order  of  the  jobs  in  the  queue. 
This  approach  was  adopted  by  Gaver  and  Humfeld  (19  76)  for 
exponential  service  times.   The  resulting  state  space  has 

\J   +  J2\   /Jl  +  J2  +  k> 

Ji 

states  if  there  are   k   distinct  PP ' s .   This  number  must  be 
greatly  increased  if  service  distributions  of  phase  type  are 


allowed.   This  approach  is  thus  seriously  limited  by  the  size 
of  the  state  space. 

We  would  like  to  develop  transition  probabilities  which 
approximate  FCFS  behavior  but  which  are  based  only  on   N . . (t ) , 
i  =  1,2;  j  =  0,1,2,  not  the  ordering  in  the  queue.   Let  us  focus 
on  a  single  service  center  with   N. (t)  jobs  of  type  i  present 
at  time  i  and  exponential   (y.)   service  rates   (i  =  1,2).   In 
the  spirit  of  processor  sharing,  we  approximate  FCFS  as  follows: 
let   A. (t)  =  N. (t  +  dt)  -  N. (t) ,  i  =  1,2.   We  assume 

P(Al(t)=-l,    A2(t)=0|N(t))    =    pJh    (S/^n    (t)/y2'dt    +   °(dt) 


P(Al(t)=0,.A2(t)=-l|N(t))    =    P2U    (t)/y^2N    (t)/y2)dt    +   °(dt) 


N    (t)     +   N    (t) 
P(Al(t)=0,    A2(t)=0|N(t))       =    1    -    Ni(t|/yi    +N2(t)/y2       dt    +    °(dt)     ' 

(3.1) 

The  motivation  for  tne  suggested  approximation  is  as 
follows.   Over  a  short  period  of  time   [t,  t  +  dt] ,  only  the  job 
currently  in  service  has  positive  probability  of  completing 
service.   This  is  in  sharp  contrast  to  (3.1)  where  both  types  have 
positive  probability  of  a  service  completion.   Nevertheless,  if 


we  focus  on  a  longer  period  of  time,  say  the  amount  of  time 
needed  to  service  all  customers  currently  in  the  queue,  then  on 
the  average   N. (t)/y.   time  units  will  be  spent  servicing  type  i 
jobs,  i  =  1,2.   Hence  the  server  will  spend  approximately  a 
fraction   (N  .  (t)  /y  .  )  /  (ISL  (t)  /y,  +  N0(t)/y0)   of  this  total  time 

1       11       1      A  z 

servicing  type  i  customers.   Approximating  the  system  using  (3.1) 
amounts  to  applying  this  fraction,  which  changes  dynamically,  to 
every  interval  of  length  dt,  rather  than  just  to  the  longer 
interval  in  which  every  customer  is  served.   The  approximation 
is  intended  to  be  applied  only  for  steady  state  calculations, 
since  it  does  not  model  the  actual  dynamics  of  a  FCFS  queue 
discipline  faithfully.   We  note  in  passing  that  this  is  only  a 
first  order  approximation.   It  may  be  improved  by  applying  the 
fraction  E(X,/(X,  +  X.))   to  each  dt   time  interval  where   X. 
and   X_   are  independent  gamma  random  variables  with  parameters 
(N  (t),y,)   and   (N  (t),y„).   This  tends  to  improve  the  approxi- 
mations, but  at  the  cost  of  a  much  more  complicated  analysis.   It 
may,  however,  be  quite  important  when  phase  type  service  distributions 
are  assumed. 

Equations  (3.1)  are  a  special  case  of  more  general  tran- 
sition probabilities  for  single  server  queues  with  multiple 
customer  types.   Suppose  there  are   T   types   and   N. (t)   is  the 
number  of  type  i  customers   (1  <_   i  <_   T)   enqueued.   Let   A.  (t) 
=  N.(t  +  dt)  -  N.(t).   Equations  (3.1)  can  be  generalized  as 
follows 


M-  N  (t) 

P(A,  (t)=-l,  A.  (t)=0,  j  ±   i|N(t))  =  -=-^ dt  +  o(dt) 

1  ^  "  I   t  a.  .N.(t) 


(3.2) 


fi=1   y±N  (t) 
P(A.  (t)  =  0,  1  <  i   :  T|N(t))   =  1  -  -^ — dt  +  o  (dt)  , 

1  ~  J.  .  a, .N. (t) 

^3=1   13  3 


Equations  (3.2)  provide  a  parametrized  family  of  single 

server  queues.   By  adjusting  the  parameters   {a.  .,  1  <_   i,  j  £  T} 

one  can  create  many  different  service  disciplines.   For  example, 

if   a. .  =  y./y-f  the  resulting  discipline  is  approximately  FCFS . 

The  case   a. .  =  1   corresponds  to  processor  sharing.   Typically 

one  would  choose   a.   =  +1   and   a.   =  1/a .  . .   By  letting  a.  . 

n  13    '    ji    J  ^        13 

approach  0  or   °°  a  priority  (of   i   over   j   or  vice  versa) 

will  be  created;  as   a. .  ■>  0,  type  i  jobs  are  given  priority 

over  type  j.   The  coefficients   a.  .   provide  relative  weights 

for  each  type  of  job  at  a  particular  server.   See  previous  work 

by  Lehoczky  and  Gaver  (1977)  utilizing  a  similar  approach;  that 

paper  also  presents  numerical  validations. 

The  parameters   a. .   have  intuitive  meaning  as  explained 

13 

before,  and  the  parametric  framework  allows  for  the  possibility 

of  optimizing  some  system  measure  of  effectiveness  (such  as 

idleness  or  queue  lengths)  by  appropriate  choice  of  the   a. .. 

Once  an  optimal  set  of   a. .   has  been  found,  it  can  be  converted 
^  13 

into  a  scheduling  algorithm  which  allocates  a  particular  weight 
to  each  type  of  customer. 
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This  methodology  (equations  (3,1)  or  (3.2))  can  easily 
accommodate  phase  distributions,  but  at  the  price  of  a  possibly 
great  increase  in  the  size  of  the  state  space.   Suppose  that  at 
a  particular  server  the  service  distribution  for  type  i  customers 
i  of  phase  type  with   n . +1   states,  initial  distribution   a., 
service  or  holding  time  vector   y.   and  transition  probabilities 

P.  ,   1  <_  i  <_   T.   We  identify  each  state  of  each  phase  distribution 

rT 
as  a  type  of  job:   there  are   S  =  l  ■  _-,    n.  types.   Let   N.  .  (t) 

be  the  number  of  type   i   jobs  in  phase   j   at  time   t, 

n . 
1  <  j  <  n.,  1£i£T-   Here  I    ii  N- • (fc)  =  N- (t) i    the  number 

of  jobs  of  type  i. 

Coefficients  {a.  .,1  i,  j  S}  can  now  be  defined  by 
establishing  the  relationship  between  types  i  and  j .  Equations 
(3.2)  can  be  easily  applied  with  T  replaced  by  S.  While  the 
number  of  states  is  potentially  enormous,  many  interesting  cases 
can  be  handled  by  solving  the  steady  state  balance  equations  by 
Gauss-Seidel  iteration  methods. 

We  have  described  the  situation  of  a  single  service  center. 
The  central  server  model  consists  of  many  servers  (CPU  and  PP's). 
The  servers  are  assumed  to  be  linked  in  a  Markov  fashion.   When 
a  type  i  job  completes  CPU  service,  it  moves  to  PP.  with  prob- 
ability   a.  .,  a.  .  ^  0,  I  ._,  a..  .  =  +1.   Upon  completing  service 
at  PP.,  it  moves  back  to  the  CPU.   The  number  of  jobs  of  each  type 
is  typically  held  fixed,  but  this  can  be  modified  to  allow  them 
to  fluctuate,  with  the  total  fixed,  in  a  straightforward  fashion. 
One  can  also  allow  the  total  number  of  jobs  in  the  system  to 
vary  with  time  although  such  models  are  of  lesser  importance. 
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4 .   An  Illustration 

To  illustrate  the  quality  of  the  approximation  given  by 
(3.1)  we  give  an  exact  analysis  of  a  very  simple  situation  in 
which  closed  form  expressions  can  be  obtained.   A  detailed  numerical 
analysis  of  a  more  realistically  sized  system  will  be  given  sub- 
sequently. 

We  study  the  simplest  possible  multitype  central  server 
model  with  a  CPU,  two  PP's  and  two  job  types,  each  with  one  job. 
To  further  simplify  the  calculations,  type  i  jobs  always  move 
to  PPi,  i  =  1,2   and  then  back  to  the  CPU.   Assume  service  rates 
A.,  i  =  1,2   at  the  CPU  and  1  at  each  PP. 

Assuming  the  CPU  is  operating  in  a  FCFS  fashion,  the  state 
space  has  5  states  defined  by  the  number  of  each  type  at  the  CPU 
and  the  type  of  job  currently  in  service  if  both  types  are  present. 
Here   x.   will  be  used  to  denote  the  long-run  probability  that 
the  system  inhabits  the  state  having  label  i. 


STATE 

LABEL 

(0,0) 

1 

(1,0) 

2 

(0,1) 

3 

(1,1,1) 

4 

(1,1,2) 

5 

BALANCE  EQUATIONS 

2X1  =  A1X2  +  A2X3 

(A.,  +  l)x~  =  X..  +  A„xc 
1        2.  1      2.    b 

(A2  +  D*3  =  X-l  +  Axx4 

A1X4  =  X2 
A2X5  =  X3 


(4.1) 


1  =  X,  +  X„  +  X-  +  X.  +  xc 
12     3     4     5 
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Equations  (4.1)  can  be  routinely  solved  to  give 


1  =  (A1X2  +  Al  +  A2)/D  ' 


x,  = 


(4.2) 


x2  =  (2  +  X2)/D  , 

x3  =  (2  +  X1)/D  , 

x4  =  (2  +  X2)/X1D  , 

x5  =  (2  +  A1)/A2D2, 

D  =  [{X  +    D2(X2  +  l)2  -  1]/X1X2 


The  model  has  only  4  states  if  the  approximation  outlined 
in  (3.1)  is  used.   States  4  and  5  in  (4.1)  merge  into  a  single 
state;  this  represents  the  advertised  economy  of  the  proposed 
approximation.   Here   y.   denotes  the  long-run  probability  of 


inhabiting  label  state  i. 


STATE 

LABEL 

(0,0) 

1 

(1,0) 

2 

(0,1) 

3 

(1,1) 

4 

BALANCE  EQUATIONS 

2yx    =    AlY2    +    A2y3 
(A1   +   l)y2   =   Y1   +    (1/X1   +   1/A2)_1y4 
(A2    +    l)y3    =   Y-l    +   y4(VA1    +    1/A2)"1 

2(i/A1  +  i/A2)_1y4  =  y2  +  y3 

i  =  y2  +  y2  +  y3  +  y4 


(4.3) 
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The  solution  is  easily  found  to  be  given  by 


yl  =  A1A2  (2A1A2 +  Al  +  A2)/E 
y2  =  2X^^X3  +  1)/E 

y3  =  2A1A2(A1  +  1)/E  (4>4) 

y4  =  (A1  +  A2) (2  +  A1  +  ^2)/E 
E  =  (A1A2  +  X±    +  A2  +  2)  (2A1A2  +  X1    +    A2) 


One  can  compare  the  results  by  aggregating   x.   and   x,. , 

so  the  state  spaces  are  the  same.   First   x,  =   y, ,  the  state  which 

corresponds  to  CPU  idleness.   For  the  other  three  states  the 

approximation  is  not  exact.   We  give  the  percent  error  of   y. 

computed  by   |x.  -  y. |/y.   where   x.   is  the  aggregation  of   x. 

and   xt . 
b 


x2  -  y2|/x2  =  A2|A2  -  Ax|/(2  +  A2)  (2AXA2 +  X±  +  A2)) 
x3  -  y3|/x3  =  Ax|  A2  -  Ax|/(2  +  Ax)  (2A1A2  +  X1+  A2)  ) 
x4-y4|/x4    =    A1A2(A2  -  A1)2/(2A1A2  +  Ax  +  A2)  (A2  +  2AX  +  A2  +  2A2)) 

(4.5) 


One  may  make  a  detailed  analysis  of  (4.5).   The  overall 
result  is  that  the  percentage  errors  are  very  small  unless  an 
extreme  case  is  chosen.   To  illustrate  we  focus  on  | x?  -  y9|/x? 
and  let   A   =  kA, .   In  this  case  the  percent  error  is  given  by 
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x2  -  Y2 I        .k(k-l) X 


x2       (2  +  k\    ) (2kA1  +  k  +  1) 


(4.6) 


For  fixed   k,  this  expression  can  be  maximized  as  a  function  of 
A1   by  selecting   A,  =  /k  +  1/k.    Substituting  this  value  into 
(4.6)  gives 


X2    Y2'  k  -  1 


max  =  ~-  (4.7) 


x2  (2  +  A+T)2 


The  following  table  shows  the  maximum  percent  error  as  a  function 
of   k. 


k  (k-l)/(2    +    A+T)2 


1  0% 

2  7.1% 

3  12.5% 

4  16.7% 

5  25.2% 
10  31.8% 
50  59.8% 

100  68.9% 

100% 
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One  can  see  that  except  in  very  extreme  cases,  the  percent 
error  will  be  very  small  indeed.   A  similar  analysis  can  be 
carried  out  on  the  other  terms  with  similar  results. 
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5 .   A  Second  Approximation 

Another  approximation  method  can  be  used  which  offers 
several  advantages,  but  some  disadvantages,  over  the  weighted 
processor  sharing  example.   We  illustrate  this  for  a  single  service 
center.   Rather  than  keep  track  only  of  the  number  of  each  job 
type  at  the  service  center  as  in  the  first  approximation,  we  expand 
the  state  description  to  include  the  number  of  each  type  awaiting 
service  and  the  identity  of  the  customer  in  service.   Arrivals 
to  the  queue  and  departures  from  the  queue  are  easily  handled 
since  the  identity  of  the  customer  in  service  and  the  number  at 
the  center  is  known.   An  approximation  is  required  to  identify 
the  type  of  the  next  customer  to  enter  service  when  a  customer 
leaves,  because  the  order  within  the  queue  is  not  known.   We 
adopt  a  random  service  order  policy  approximation.   Specifically, 
if  W. (t)   represents  the  number  of  type  i  jobs  waiting  for 
service,  i  -  1,2   and   I(t)  =  i   if  a  type  i  job  is  in  service, 
then  we  assume,  letting   A.  =  W. (t  +  dt)  -  W. (t) 

W,(t) 

P(A1=-1,  A2=0,  I(t+h)=l|W(t) ,  I(t)=l)  = v±   w  (t)+w  (t)  dt  +  o(dt) 

W9(t) 
p(A1=o,  a2=-i,   i(t+h)=2|w(t)  ,   i(t)=D  =  m1  vTTtlTw~TtT  dt  +  o(dt) 

w    (t) 
P(A1=-1,    A2=0,    I(t+h)=l|W(t)  ,    I(t)=2)  =  P2   w    (t)+w    (t)    dt   +   °<dt> 

w    (t) 

P(A1=0,    A2=-l,    I(t+h)=2|W(t),    I(t)=2)  =  \i2   w    (t);w    (t)    dt   +  o(dt) 

(5.1) 
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This  can  be  easily  extended  to  many  service  centers  and  provides 
a  second  approximation  to  FCFS  service  disciplines.   The  numerical 
accuracy  will  be  assessed  in  the  next  section. 

This  approximation  requires  a  slightly  larger  state  space 
than  the  weighted  processor  sharing  (3.1)  approximation  for 
exponential  service  distributions.   Nevertheless  if  phase  type 
distributions  are  introduced  the  state  space  for  (5.1)  is  much 
smaller  than  for  (3.1).   Phase  type  distributions  can  be  very 
easily  accommodated.   Another  advantage  is  that  (5.1)  provides 
better  accuracy  than  (3.1),  although  both  give  excellent  results. 
On  the  negative  side  (5.1)  cannot  be  conveniently  changed  to 
allow  for  other  types  of  queue  disciplines. 
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6 .   Numerical  Illustrations 

Numerical  studies  were  carried  out  using  (3.1)  and  (5.1) 
and  were  compared  with  the  results  of  Gaver  and  Humfeld  (19  76) . 
Below  we  present  the  results  for  three  cases.   In  all  cases  there 
are  two  PP '  s  and  two  job  types.   The  CPU  service  rates  are  \    ,    \_, 

while   (y-i-i'  ^12^   are  tnose  for  ppl  and   ^21'  M22^   for  PP2  • 

a,.   and   a~,   are  the  probabilities  a  type  1  or  type  2  job  moves  to 

PPl  upon  leaving  the  CPU.   J.   is  the  fixed  number  of  type  i  jobs, 

i  =  1,2. 

Method  1  refers  to  the  results  of  Gaver  and  Humfeld  (1976) 
obtained  by  a  Gauss-Seidel  iteration  of  the  balance  equations  for 
the  exact  system.   Method  2  refers  to  the  steady  state  results 
obtained  using  a  Gauss-Seidel  iteration  of  the  balance  equations 
derived  from  (3.1)  ,   the  weighted  processor  sharing  approximation. 
Method  3  refers  to  the  approximation  based  on  a  random  source 
order  (5.1).   The  results  were  obtained  using  simulation.   The 
results  are  based  on  120,000  system  transitions,  and  estimated 
standard  errors  are  provided  with  each  quantity. 

The  numerical  values  given  in  the  previous  tables  illustrate 
the  exceptional  accuracy  of  both  approximation  method  across  a  broad 
number  of  cases.   The  largest  absolute  error  is  .02,  thus  the 
approximations  are  extremely  useful.   The  tables  illustrate  that 
method  3  (based  on  (5.1))  is  more  accurate  than  method  2  (based  on 
(3.1)).   Method  2  allocates  slightly  too  much  time  to  slow  jobs, 
slightly  too  much  to  fast  jobs.   This  results  in  the  slight  but 
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systematic  differences  between  methods  1  and  2.   In  view  of 
the  minor  differences,  the  complicated  correction  mentioned  in 
section  3  is  certainly  not  called  for. 

The  tables  illustrate  that  method  3  should  be  used  when- 
ever possible.   This  will  be  especially  true  if  phase  type  dis- 
tributions are  required.   The  accuracy  is  better  than  method  2 
and  the  state  space  requirements  may  be  substantially  reduced. 
Method  2  can,  however,  serve  as  a  starting  place  for  calculating 
approximate  closed  form  expressions  for  occupancies  and  idleness 
probabilities,  say  by  using  a  diffusion  approximation  analysis. 
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X   =  15 
»11  =  10 
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=  20 


X2  =  25 

"12  =  20 

U22   =  10 


a    =75 
11 

a    =   25 
21 


Occupancy 

Idleness 

(J1'J2) 

Method 

CPU 

PP1 

PP2 

CPU 

PP1 

PP2 

(1,1) 

1 

.830 

.582 

.588 

.406 

.519 

.501 

2 

.827 

.566 

.607 

.403 

.524 

.483 

3 

.830  (.003) 

.587(.004) 

.587(.006) 

.409(.001) 

.518(.002) 

.505(.005) 

(1,2) 

1 

1.172 

.613 

1.215 

.336 

.537 

.284 

2 

1.163 

.590 

1.247 

.334 

.544 

.266 

3 

1.172(.013) 

,616(.003) 

1.219(.013) 

.337(.007) 

.535(.004) 

.283(.001) 

(2,1) 

1 

1.342 

1.093 

.565 

.282 

.341 

,556 

2 

1.343 

1.074 

.582 

.277 

.345 

.538 

3 

1.346(.012) 

1.085(.019) 

.576(.007) 

.28K.006) 

.342(.005) 

.533(.005) 

(1,3) 

1 

1.444 

.613 

1.943 

.305 

.558 

.165 

2 

1.425 

.587 

1.988 

.306 

.565 

.151 

3 

1.444(.019) 

.627(.006) 

1.940(.018) 

.309 (.006) 

.556(.004) 

.170(.003) 

(2,2) 

1 

1.779 

1.106 

1.115 

.224 

.367 

.355 

2 

1.777 

1.077 

1.146 

.220 

.372 

.334 

3 

1.794(.024) 

1.104(.010) 

1.112(.015) 

.22K.003) 

.369(.005) 

.359(.005) 

(3,1) 

1 
2 
3 

1.839 
1.844 
1.826(.009) 

1.626 
1.608 
1.637(.009) 

.535 
.547 
,547(.009) 

.218 
.214 
.22K.002) 

.245 
.248 
.242(.002) 

.594 
.579 
.59K.003) 

(3,3) 

1 
2 
3 

2.847 
2.846 
2.836(.076) 

1.572 
1.536 
1.600(.036) 

1.581 
1.618 
1.583(.042) 

.138 
.134 
.140 (.009) 

.296 
.300 
.297(.006) 

.286 
.268 
,292(.008) 

(2,5) 

1 
2 
3 

2.672 
2.619 
2.684 (.048) 

.998 
.959 
1.02K.022) 

3.330 
3.422 
3.315(.047) 

.182 
.182 
.180 (.006) 

.441 
.447 
.438(.003) 

.096 
.085 
.100(.006) 

(5,2) 

1 

3.459 

2.690 

.851 

.115 

.169 

.491 

2 

3.475 

2.664 

.861 

.111 

.172 

.477 

3 

3.456(.078) 

2.  709  (.077) 

.854(.025) 

.118(.005) 

.172(.008) 

.493(.014) 
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Case    II 


Xl   =    0,526 
yu   =   1.0 
y21   =   1.0 


A,    =   0.339 


'12 


=   1.0 


y22   =    1.0 


all   =   1-° 
a21   =   0.0 


Occupancy 

Idleness 

(JrJ2) 

Method 

CPU 

PPl 

PP2 

CPU 

PPl 

PP2 

(1,1) 

1 

1.610 

.200 

.190 

.059 

.800 

.810 

2 

1.608 

.205 

.187 

.059 

.795 

.813 

3 

1.609(.005) 

.20K.002) 

.192 (.003) 

.060 (.002) 

,800(.002) 

.809(.0( 

(1,2) 

1 

2.575 

.135 

.290 

.014 

.865 

.753 

2 

2.571 

.136 

.292 

.014 

.864 

.754 

3 

2.574(.001) 

.135(.003) 

.293(.002) 

.014(.001) 

.866 (.003) 

.751  (.00 

(2,1) 

1 

2.500 

.353 

.148 

.018 

.713 

.852 

2 

2.503 

.351 

.146 

.018 

.709 

.854 

3 

2.503(.011) 

.351 (.010) 

.149(.002) 

.018(.001) 

.715 (.006) 

.852(.0C 

Case    III 


A,    = 


lll 


l21 


0.6 
1.2 
0.9 


A2  =  0.8 
y12  =  1.0 
y22  =  0.5 


a, 1    =    .55 


a 
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.30 


Occupancy 

Idleness 

(J1'J2> 

Method 

CPU 

PPl 

PP2 

CPU 

PPl 

PP2 

(4,4) 

1 

6.107 

.345 

1.548 

.011 

.742 

.372 

2 

6.152 

.347 

1.501 

.009 

.742 

.376 

3 

6.113( 

.062) 

.342( 

.015) 

1.56K 

.060) 

.012  ( 

.003) 

.744( 

008) 

.374 (.00 
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